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SE  “Research” 


Statements  on  SE  Research  by  INCOSE 


+nn?mm+ 

SnS^mettonel  Council  on  Systerr&E  £n^inesru?g 


-  Systems  engineering  is  an  integrative  discipline  which,  like  other 
engineering  specialties,  needs  vibrant  research 


-  INCOSE  advocates  the  articulation  of  programs  in  basic  and  applied 
research  in  Systems  Engineering 


-  INCOSE  supports  strongly  doctoral  level  research  in  Systems 
Engineering 


System  Science  Working  Group 

System  Science  is  the  enabling  theoretical  foundations  and  scientific 
underpinnings  of  systems  engineering  that  contribute  to  better 
understanding  of  systems  engineering  practice,  particularly  of  complex 
systems  and  large-scale  enterprises 

Conference  on  Systems  Engineering  Research  (CSER) 


eonfaranca  on  systeiraanE^waring  research 


5th  Annual  Conference  on  Systems  Engineering  Research 

MARCH  14-16,  2007 

Stevens  Institute  of  Technology  Campus 

Hoboken,  New  Jersey _ 


•  All  SE  graduate  programs  require  a  capstone  project 

-  Group  projects  provide  integrated  design  team  experience 

•  Thesis  for  Masters  (12  credits,  3  qtrs) 

•  Capstone  Design  Project  for  IDE  (9  credits,  3  qtrs) 

•  Capstone  for  Certificate  (4  credits,  1  qtr) 

-  Individual  Dissertation  for  Ph.D.  students 

•  AFIT  solicits  research  grants  just  like  civilian  institutions 

-  Resident  military  student  tuition  is  paid  for,  but ... 

-  Civilian  faculty  are  on  academic  year  appointments  (10  months),  and  ... 

-  AFIT  is  not  budgeted  for  research  related  travel,  supplies,  and  equipment 

-  We  are  cheap,  but  we  are  not  free! 

•  Funding  for  the  SE  group  has  been  growing 

-  Over  $600K  in  2008 

-  Has  allowed  us  to  bring  faculty  from  other  programs  onto  SE  projects 


Balance  Application  of  SE  Practice 
with  Basic  SE  Research 


Last  year,  the  balance  clearly  tipped  towards  the  applied  research  side 

*  Only  one  PhD  student  (our  first)  in  dissertation  research 

•  Sponsors  of  MS  student  research  tend  to  focus  more  on  application 


Balance  Application  of  SE  Practice 
with  Basic  SE  Research 


Applied  Systems  Engineering 
Research  SE  Capstone  Projects 


SE  Basic  Research 
Future  SE  methods/  practice 


This  year,  the  balance  has  been  tipped  towards  more  basic  research 

•  More  PhD  students  in  dissertation  research 

•  Greater  effort  to  “shape”  MS  topics  to  address  more  fundamental 
questions 


BASIC  RESEARCH 


Challenge 

Who  funds  Basic  SE  Research? 


•  National  Science  Foundation 

-  Funds  System  Science,  but  typically  not  Systems  Engineering 

•  AFOSR 


-  Responsible  for  oversight  and  management  of  the  Air  Force  program  in 
basic  research  (6.1) 

-  Orchestrates  the  research  program  with  universities,  industry,  other 
government  organizations,  and  the  AF  Research  Lab  (AFRL)  technical 
directorates 

-  AFOSR  funding  -  traditional  science  areas 

•  Aerospace  and  Materials  Sciences 

•  Physics  and  Electronics 

•  Mathematics,  Information  and  Life  Sciences 

•  SE  University  Affiliated  Research  Center  (UARC) 

-  New  initiative,  funded  by  OSD,  NSA 

-  Award  will  be  announced  Oct  08  -  Stevens  Institute  leading  a  large  multi¬ 
university  team 

-  AFIT  will  participate  in  the  UARC  with  the  Stevens-led  team 


We  invite  the  AF  CSE  advisory  council  to  help  identify  SE  basic 
research  funding  sources 


AFIT  Basic  Research  Threads 


A  Sample  of  SE  Basic  Research  at  AFIT 

•  SE  process  improvements 

-  Modeling  and  evaluation  of  architectures 

-  Modeling  cognitive  processes  within  the  DoD 
Architecture  Framework 

•  System  of  Systems/  Network  Centric  Systems 
Analysis 

-  Graph  Theory  of  Network  Centric  Operations 

-  Interoperability  Measurement 

•  Integrated  Health  Monitoring 

-  Reliability  models  to  support  life  cycle  system  design 

•  Human  Systems  Integration  (HSI)  Design 

-  Graph  theoretic  analysis  for  HSI  evaluation  and  design 

•  Modularity  in  design  vs.  performance 


Problem:  The 
design  of  complex, 
socio-technical 
systems  requires 
that  critical  aspects 
of  the  whole 
integrated  system  be 
specifically  defined 
upfront  so  that  the 
implemented 
solution  addresses 
human  system 
integration  (HSI) 
facets  as  well  as 
technical  system 
integration  facets. 
HSI  factors  and 
constraints  are  not 
incorporated  in  the 
US  Military 
acquisitions  process 
until  late  in  the 
process  resulting  in 
unnecessary  risk 
incurred,  cost 
overruns,  and 
mission  shortfalls. 
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Architecting  Cognition  within  the  Department  of 
Defense  Architecture  Framework  (DoDAF) 


Ftosbiirsh  Sponsor:  ArPUPP,  XJPijht-Patiarson  ArE 
D^vid  O'to JsiJJsy  Major  2aJJ 


Method:  Define  the  cognitive  aspect  of  Human  Factors  and  develop  a  model  of  cognitive  and 
pseudo-cognitive  (CPC)  elements  for  inclusion  in  DoDAF  via  the  Core  Architecture  Data  Model 
(CADM).  Demonstrate  the  efficacy  of  DoDAF  extended  with  CPC  model  during  the  Joint 
Capabilities  Integration  Development  System  (JCIDS)  process. 


DoDAF  version  1.5 


Cognitive  Elements 


CADM  with  CPC  Extension 


J . 


L“l 

^  r 


I  HtimanBefiaviorTask  I  OperabonaRole 


Fundamental  Cognitive  Tasks 


DoDAF  version  1.5 
Operational  View-5 


New  Operational  View 
incorporating  CPC  tasks 


Results: 

*  Standardized  means  for  incorporating  elements  of  human  cognitions  (Environments, 
Roles,  Tasks,  Inputs  and  Outputs) 

*  Accurate  solution  trade  space  constraints  with  traceable  manpower,  personnel,  and 
training  requirements 

*  Decreased  cost,  risk,  and  mission  shortfalls  of  final  solution 

*  Provide  foothold  for  all  other  elements  of  HSI  within  the  JCIDS  process 


The  method: 

1.  Accepts  all  system  types  (e.g.,  coalitions,  technology,  organizations,  cultures,  etc.) 

2.  Accepts  all  interoperability  types  (e.g.,  enterprise,  joint,  semantic,  technical,  etc.) 

3.  Describes  interoperability  in  the  context  of  an  operational  process 

4.  Provides  for  higher  precision  of  measurement 

5.  Introduces  confrontational  interoperability  and  relates  it  to  operational  effectiveness 

6.  Accommodates  all  types  of  interoperability  characteristics 

7.  Capitalizes  upon  existing  architecture  data 


10 


Introduction 

Literature  Review  &  Analysis 
Interoperability  Measurement  Method 

Conclusion 


INTEROPERABILITY  MEASUREMENT 


Suppression  of  Enemy  Air  Defenses 


Operational  Process 


act  SEAO  [Activity  Diagram] ^ 


Interoperability  Model* 


S  =  {SB,SR}  =  {{HB,  ISR,  AOC,  PSP} ,  { IADS \ ,  IADS2}} 

f  27  characters  representing  [ 

[joint  operational  function  hierarchy] 

C  =  {0,1) 

,  ,  [Percent  of  enemy  air  defenses  destroyed, 

o={o„,oR}=' 


I  =  Simm, 


Percent  of  enemy  air  defenses  protected  J 

*  System  instantiation  not  pictured  due  to  large  size 


Interoperability  Measurement 

M  = 

HB  ISR  AOC  PSP  IADS \  IADS,' 

HB 

ISR 

AOC 

PSP 

IADS \ 

iads2 

0  1/  1/  1/  2/  2/ 

w  /9  79  79  /27  /27 

X  9  y21  Yn  X  x 

X  X  9  X7  Yn  Vn 

X  X  X  9  /1  X7 

X7  X7  X7  xVn  9  X 

X7  X7  X7  ]%7  X  9 
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INTEGRATED  STRUCTURAL  HEALTH  MONITORING 


>  in  <==== 

Aj»rt»n  H  *»hh 

Aircraft  Structural  Health 


Fleet  Structural  Health 


Research  Question 

How  can  the  capability  of  a  Structural  Health 
Monitoring  system  be  estimated  over  the 
remaining  life  of  a  legacy  aircraft? 

—  Critical  to  maintaining  a  SHM  system  after 
installation 

—  Provides  information  for  SHM  system  design 
trade-offs 


R*<|US*ilO*pot  Krjiiiri 

|)  - 

3)  - - 


Rtqpn'dFitM  R«p%»* 

0  - 


—  Provides  information  for  Cost-benefit 
analysis 

•  More  SHM  maintenance  =  Less  cost  savings 

-  Method  must  relate  to  current  practice  for 
practical  acceptance 


OPTIMAL  INPUT  DEVICE  DESIGN  FOR  IMPROVED  HUMAN  SYSTEMS  INTEGRATION 


IV.  Verification 
V.  Selection 
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III.  Alternative  Design 


3:  "Operational  grouping" 


I.  Requirements  Generation 
Mission:  Multi-role 
n=63 

Pa,b 

t;=1.0ms 


'll.  Task 


Analysis 


wmmmr  4o  ^ 


50  60 
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APPLIED  RESEARCH 


AFIT  Applied  Research  Threads 


A  Sample  of  Applied  SE  Research  at  AFIT 

*  Rapid  Response  to  Urgent  Warfighter  Needs 

*  Interdisciplinary/Interdepartmental  Projects 

-  Cooperative  small  air  vehicle  surveillance  concepts 

*  Early  SE  Application  for  Technology  and  Capability 
Planning 

-  Analysis  of  functional  autonomy 

-  Process  modeling  and  risk  analysis  for  decision  making 

*  Architecture  Modeling  for  Concept  Evaluation 

-  Evaluating  military  worth  using  architecture  based  discrete 
event  simulations 

*  Spacecraft  Dynamics  and  Control  Testbed 


Srs, 


AIR  FORCE  CENTER  FOR  SYSTEMS  ENGINEERING 
Systems  Engineering  Analysis  For  Transition 
of  Fleeting  Target  Demonstrator 

Maj  Laird  Abbott,  MaJ  Craig  Phillips,  Ur.  Christian  Stillings,  Capt  Garrett  Knowlan 


Operations  Concept 
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Functional  Area  Analysis 
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Functional  Needs  Analysis 
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Functional  Solutions  Analysis 
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Architecture 
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Risk  Analysis 
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A  Focused  Systems  Engineering  Approach  to  Rapidly  Transition  Technology  to  the  Warfighter 
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AIR  FORCE  CENTER  FOR  SYSTEMS  ENGINEERING 

An  Analysis  of  Functional  Autonomy 

Sponsored  by  AFRL/RBAA 

LCDR  Scott  Rivera  Captain  Anil  Hariharan  Captain  Alan  Louie 


Establish  2035  Vision 


Problem 


Global  Strike 
Persistent  Attack 
Time  Sensitive  Attack 
Nuclear  Strike 
Show  of  Force 


Planners 

Operators 

Doctrine 

Guidance 


Operational 

Concept 


Phase  II 

Next  Generation  LRS 


Phase  III 

Revolutionary 

LRS 


Describe  System 


B-52  Stratofortress 


Identify  Human  Roles 


Perception 


Execution 


Can  the  2035  LRS  System 
be  Automated? 


External  Systems 
\  Diagram 


LRS  Activity 
Diagram 


High  Level  Activity 


Low  Level  Activity 


Planning 


System 

Function 


Sub-System 


Navigator 


Increasing  Autonomy 


Weaponeer 


Illustrative  Variants 


Forecast 

Technology 


Interpretation 


Data  Analyst 


Data  Fuser 


Data  Sorter 


Decision  Maker 


System  Health  Analyst 


Results 

*  The  2035  LRS  system  can  be  Automated 

*  Concept  can  be  linked  to  enabling  Technologies 


Technology 


Goal  Monitor 

Final  Safety 

Radio  Operator 

System  Director 

Sensor  Operator 

Role 
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AIR  FORCE  CENTER  FOR  SYSTEMS  ENGINEERING 

Creating  a  Discrete  Event  Simulation  to  Determine  the  Military  Worth 
of  Developing  an  Electronic  Warfare  Battle  Manager  Function 
within  an  Airborne  Electronic  Attack  System  of  Systems  Architecture 

Research  Sponsor:  Capability  Planning  Office  ASC/XRS,  Wright-Patterson  AFB,  OH 
Mrs.  Trina  Bornejko,  Maj  Charles  Glasscock,  Maj  Dennis  Sprenkle 


Results 

Measures  of  Effectiveness 

No  EWBM 

EWBM 

Baseline 

No 

Decision 

Authority 

Limited 

Decision 

Authority 

Full 

Decision  | 
Authority  | 

Ml  Minutes  to  reassign  AEA  Assets 

o 

o 

o  1 

M2  Percent  reduction  in  of  SAM  detection  rate  due  to  jamming 

o 

o 

° 

M3  Percent  of  strike  aircraft  Pd  by  Pop-up  SAMs  on  route 

o 

o 

o 

M4  Percent  of  strike  aircraft  Pd  by  known  SAMs  on  route 

o 

o 

o  | 

M5  Percent  of  strike  package  attritions  due  to  enemy  air  defenses 

m 

o 

M6  Percent  of  strike  packages  whose  mission  is  degraded  by  enemy  air 

1  defenses 

o 

o 

° 

( _ )  Statistically  significant  improvement  I 

(^)  No  statistically  significant  improvement  or  degradation 

Statistically  significant  degradation 

ARENA  Simulation 


Problem  Statement 

How  can  the  AEA  SoS  architecture  be 
used  to  evaluated  the  military  worth  of  an 
Electronic  Warfare  Battle  Management  (EWBM)? 


Architecture  Based 
Evaluation  Process 


AEA  SoS  Architecture 


Falcon  View  Mission  Plan 


Issl 

J 

H 

L 

Challenge: 

Finding  the  best  projects 


•  We  invite  the  committee  to  sponsor  relevant  projects  for  our 
SE  students 


Target  Times  for  new  projects:  May-August  (Certificate  and  IDE),  Nov-Feb  (Quota) 


Conclusion 


•  AFIT  is  focusing  more  effort  on  Basic  SE  Research 

-  Interoperability 

-  Reliability  and  Integrated  Health  Monitoring 

-  Design  for  Human  Systems  Integration 


•  SE  Research  should  include  applied  research  activities  in  SE 
process  improvement 

-  Early  Enterprise  and  System  Architecture  and  evaluation 

-  Executable  Architectures 

-  Network  Centric  Operations  modeling  (graph  theory,  CPNs) 


Contact  Us  - 
We  are  here  to  solve  complex  DoD  problems 


Adedeji  Badiru,  Ph.D.,  P.E. 

-  Chair,  Dept  of  Systems  &  Eng.  Mgt. 

-  Industrial  &  Systems  Engineering 

-  adedeii.badiru@afit.edu 

-  937-255-3636  x4799 


David  Jacques,  Ph.D. 

-  SE  Curriculum  Chair 

-  Aeronautical  and  Mechanical  Engineering 

-  Cooperative  Control,  Optimization,  Early  SE 

-  david.iacques@afit.edu 

-  937-255-3636  x3329 


Contact  Us  - 

We  are  here  to  solve  complex  DoD  problems 


John  Colombi,  Ph.D. 

-  Electrical  &  Computer  Engineering 

-  Architecture,  HSI,  System  of  Systems 

-  iohn.colombi@afit.edu 

-  937-255-3636  x3329 


Som  Soni,  Ph.D. 

-  Mechanical  and  Materials  Engineering 

-  Integrated  Structural  Health  Monitoring 

-  som.soni@afit.edu 


-  937-255-3355  x3420 


Contact  Us  - 
We  are  here  to  solve  complex  DoD  problems 


Alan  Heminger,  Ph.D. 

-  Management  Information  Systems 

-  Knowledge  Mgt,  Information  Sharing 

-  alan.heminqer@afit.edu 

-  937-255-3636  x7405 


Maj  Brian  Hasty 

-  Business,  Information  Resource  Mgt 

-  Information  Resource  Management 

-  brian.hastv@afit.edu 

-  937-255-3636  x4605 


Contact  Us  - 
We  are  here  to  solve  complex  DoD  problems 


Dennis  Strouble,  Ph.D.,  JD 

-  Business  Law,  Engineering  Management 

-  Mgt.  Information  Systems,  Systems  Mgt. 

-  dennis.strouble@afit.edu 

-  937-255-3636  x3323 


Lt  Col  Pat  Kee,  Ph.D. 

-  Physics 

-  Product  Development,  Nuclear  Systems 

-  patrick.kee@afit.edu 


-  937-255-3636  x4648 


Contact  Us  - 
We  are  here  to  solve  complex  DoD  problems 


Maj  Jeff  Havlicek 

-  Operations  Research 

-  Utility  Theory,  Value  Focused  Thinking 

-  ieffrev.havlicek@afit.edu 

-  937-255-3355  x3348 


Brad  Ayres,  Ph.D. 

-  NRO  Visiting  Chair  (Aerospace  Corp.) 

-  Systems  Management,  Space  Systems 

-  bradlev.avres@afit.edu 

-  937-255-3636  x3422 


Contact  Us  - 
We  are  here  to  solve  complex  DoD  problems 


Jonathan  Black,  Ph.D. 

-  Astronautical  Engineering 

-  Dynamics,  Space  Systems 

-  ionathan.black@afit.edu 

-  937-255-3636  x4578 


Rich  Cobb,  Ph.D. 

-  Astronautical  Engineering 

-  System  Identification,  Space  Systems 

-  richard.cobb@afit.edu 


-  937-255-3636  ext:  4559 


Contact  Us  - 
We  are  here  to  solve  complex  DoD  problems 


Charles  Parks,  Ph.D.  (Adjunct) 

-  Industrial  and  Systems  Engineering 

-  Lean  Systems,  Statistical  Methods 

-  Charles.parks.ctr@afit.edu 

-  937-255-3636  x4617 


Joe  Carl,  Ph.D.  (Adjunct) 

-  Electrical  and  Computer  Engineering 

-  Industry  SE  Experience,  Pattern  Recognition 

-  ioseph.carl.ctr@afit.edu 


% 


-  937-255-3355  x3351 


QUESTIONS  ? 


Backups 


Research  Definitions 


Basic  Research  Basic  research  is  systematic  study  directed 
toward  greater  knowledge  or  understanding  of  the  fundamental 
aspects  of  phenomena  and  of  observable  facts  without  specific 
applications  towards  processes  or  products  in  mind.  It  includes 
all  scientific  study  and  experimentation  directed  toward 
increasing  fundamental  knowledge  and  understanding  in  those 
fields  of  the  physical,  engineering,  environmental,  and  life 
sciences  related  to  long-term  national  security  needs.  It  is 
farsighted  high  payoff  research  that  provides  the  basis  for 
technological  progress. ... 

Refs:  Office  of  Management  and  Budget  Circular  A-1 1  on  budget 
regulations,  Federal  Acquisition  Regulations,  DOD's  Financial 
Management  Regulation  (DOD  7000. 14-R) 


Research  Definitions 


Applied  Research  Applied  research  is  systematic  study  to 
understand  the  means  to  meet  a  recognized  and  specific 
need.  It  is  a  systematic  expansion  and  application  of 
knowledge  to  develop  useful  materials,  devices,  and 
systems  or  methods.  It  may  be  oriented,  ultimately,  toward 
the  design,  development,  and  improvement  of  prototypes 
and  new  processes  to  meet  general  mission  area 
requirements.  Applied  research  may  translate  promising 
basic  research  into  solutions  for  broadly  defined  military 
needs,  short  of  system  development. ... 

Refs:  Office  of  Management  and  Budget  Circular  A-1 1  on 
budget  regulations,  Federal  Acquisition  Regulations,  DOD's 
Financial  Management  Regulation  (DOD  7000. 14-R) 


